Audible barcode system

ABSTRACT

A system using a mobile Internet device with ability to scan a barcode in which a uniform resource locator (URL) is placed, and plays a transmitted audio signal activated by the URL in a Cloud database where both audio and word contents are stored. From general information for direction, instruction and information on the bottle of medicine, nutrition facts and ingredient tables on the packages of food, monthly bills, invoices, menu, magazines, to advertisement—all are either possessed of limited language translation options or use small font to explain something in a limited space. The system provides translation options and an audible signal.

RELATED APPLICATION

This application is a continuation of U.S. application Ser. No.15/134,532 titled “Audible Barcode System and Method” filed on Apr. 21,2016, now U.S. Pat. No. 9,697,333 issued on Jul. 4, 2017, which claimsthe filing priority of U.S. Provisional Application No. 62/151,406titled “A Method Uses 2D Barcode to Quickly Sort in Cloud Database andListen Transmitted Audio in Mobile Internet Devices” and filed on Apr.23, 2015. The '406 application is hereby incorporated by reference.

TECHNICAL FIELD OF INVENTION

The present invention relates to a system and method for providingaudible information through a mobile device using typical barcode labelsand a database.

BACKGROUND OF INVENTION

It has long been a problem in the healthcare and medical fields toprovide packaging which conveys all the important information about aproduct to a user. Packaging which is too large can hold considerableinformation, but is difficult to carry about in a pocket or purse.Conversely, packaging which is small is easier to carry, but providesvery limited space for printing valuable information. This problem is ofparticular concern where over-the-counter (OTC) and prescriptionmedications are involved.

As the required warning labels and use instructions have increased overthe years, even large containers could no longer provide adequate spacefor printing of critical information. In response, some companies haveused long labels which fold onto themselves and can be expanded by theconsumer to reveal information about a product. The problem with all ofthese packages is that the print is often too small to read. They alsofail to address situations where the reader is unable to read and/orunderstand the printed information due to a language barrier, anaffliction of sight, a reading disorder, or merely as a result ofcommonly misreading information.

In a seemingly unrelated technology, using a Cloud-based computer anddatabase, there is virtually unlimited space to store static wordcontents and their continuous audio signals and allow the computingpower to effectively and quickly sort and process this data. As a resultof this technology, the “mobile Internet” is growing rapidly. In theUnited States, an estimated 30% of web browsing and 40% of social mediause are done on mobile devices such as smartphones and tablets(“Embracing the Internet of everything to capture your share of $14.4Trillion,” by J. Bradley, J. Barbier, and D. Handler, Cisco Systems,Feb. 12, 2013).

Further, it is currently an existing feature to allow 2D barcodescanning by a smartphone for the purpose of identity verification or toreceive product information. However, no known technologies ordevelopers are focusing on effectively translating word content on paperto an audio voice (i.e., read to you in real time) using only a simpleaction without scanning entire subject word contents.

The invention of the present application is designed to address theseand other issues faced by the healthcare and medical industries. Thedisclosed system and method provide a viable alternative for individualsand facilitates proper usage of products, such as OTC and prescriptionmedications, with numerous advantages in simplicity and effectiveness.

SUMMARY OF INVENTION

There is disclosed herein an improved system and method which avoid thedisadvantages of prior devices while affording additional structural andoperating advantages.

Generally speaking, the disclosed method provides an audio signal to anelectronic device via an Internet connection where the audio signal isrelated to printed information associated with a barcode.

In a specific embodiment, the method comprises the steps of creatingtext content based on the printed information, recording an audio signalin a first language based on the printed information in a secondlanguage, editing the text content into text segments based on meaning,listing the text segments in a table, defining audio segments of theaudio signal by start and stop time code sequences of the recording,wherein the audio segments correspond with listed text segments in thetable, adding the time code sequences to the table for the text segmentbased on the corresponding audio segment, adding a location to the tablefor each text segment in the text content, storing the audio signal andtext segments in table format on a cloud-based server, generating aunique URL linked to the stored audio signal and text segments and to aweb-based audio play application, generating a barcode containing theURL, and scanning the barcode to activate the audio signal.

Generally, in the disclosed system, an audio signal is provided to anelectronic device via an Internet connection where the audio signal isrelated to printed information associated with a bar code.

In a specific embodiment, the system comprises a container having aproduct therein and printed instructions thereon associated with theproduct, a barcode affixed to the container proximate the printedinstructions, wherein the barcode comprises a URL which links to aserver having an audio signal corresponding to the printed instructionsstored thereon, a scanning device having an Internet connection forreading the barcode, following the URL link to the server, andactivating the stored audio signal, and a speaker coupled to thescanning device for playing the audio signal.

With a smartphone or Internet devices (such as Medical Pendant), peopleare able to scan a 2D barcode and listen the contents printed at a smallarea with a small font otherwise have to use prescribed glass ormagnified glass with proper lighting, as long as there is a 2D barcodeat the next print area. It can be applied as translator to overcomelanguage barrier in different language environment.

These and other features, elements, functions, benefits and uses for thedisclosed system and methods will be more understood the detaileddescription given herein below and the accompanying drawings.

BRIEF DESCRIPTION OF DRAWING

For the purpose of facilitating an understanding of the subject mattersought to be protected, there are illustrated embodiments thereof, froman inspection of which, when considered in connection with the followingdescription, the subject matter sought to be protected, its constructionand operation, and many of its advantages should be readily understoodand appreciated.

FIG. 1 is a screen shot of Aegisub (http://www.aegisub.org/), a freeopen-source tool for creating and modifying subtitles to audio;

FIG. 2 illustrates an example of URL links generated by an embodiment ofthe present system and method;

FIG. 3 illustrates an example medicine bottle with a barcode label inaccordance with an embodiment of the present system and method;

FIG. 4 is a table in illustrating text in a document segmented accordingto meaning and associated with an audio time sequences; and

FIG. 5 is a flow chart of an exemplary embodiment of the disclosedsystem and method.

DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT

While this invention is susceptible of embodiments in many differentforms, there is shown in the illustrations and will herein be describedin detail at least one preferred embodiment of the invention with theunderstanding that the present disclosure is to be considered as anexemplification of the principles of the invention and is not intendedto limit the broad aspect of the invention to any of the specificembodiments illustrated or described.

Generally speaking, with reference to FIGS. 1-5, the present system andmethods comprise use of 2D barcodes, a database and a mobile device toprovide audio to a user whereby the audio is related to productinformation. Preferably, the barcode is applied to a label havingimportant and sometimes critical use information for a medical product,including but not limited to OTC drugs, prescription medication, dietarysupplements, vitamins, and the like. The 2D barcodes store a URL (seeFIG. 2) and quickly sort continuous Audio signals to match the wordcontents in the Cloud and transmit it to mobile device (e.g., a medicalpendant). The mobile device is then able to audibly convey the wordcontents to the user.

Preferably, the audible content is related to “instructions for use” ona bottle for a medical product (see FIG. 3) and is activated by scanningthe 2D barcode with a single click (like taking a picture). For example,the audible content may include product name, daily dosage information,warnings, possible side effects of use, prescribing doctor information,and any other details which a user might need to be aware of regardingthe product and its use. Further, with the user's personal informationcarried in the smart device, the URL can be assembled with languageindices so that a translation context can be read according to theuser's preferred language.

A key component of the system is the use of a subtitle editing program.A preferred program is known as Aegisub™ (http://www.aegisub.org/)developed by N. Hansen and R. Monteiro. Aegisub™ is a free, open-source,cross-platform, subtitle editing program. It is extensively used in whatis known as “fansubbing,” the practice of creating or translatingunofficial, noncommercial subtitles for visual media by fans. Thesoftware is considered the standard in fansubbing, and has beenrecommended in the online “Guide to Fansubbing.” FIG. 1 illustrates anAegisub user interface.

The disclosed system does not use this program tool to edit information.Rather, it is used to correlate a relation between time code sequencesand text contexts. The Aegisub interface of FIG. 1 consists of threesections. In a top left section, a particular text content and itslocation in time code sequence (similar to progress bar) are shown. In atop right section, in addition to the word content, start and end timecode sequence and the content location in a word document—e.g., startfrom left, end at right, and which line—is shown. In the bottom section,a table is shown where start and end time code sequences are associatedwith an audio block, as well as the location of text content in the worddocument (e.g., left, right, the line number).

For example, in line #1355 (FIG. 1), the text content reads “Making thethird season true to the original . . . ” and has its location at theoriginal word document (0560, 0070, 0080). The line entry also carriesthe time code sequences representing the audio block. All informationregarding to “Making the third season true to the original . . . ” hasbeen built in one line with a table index of 1355. Using the same steps,an entire document can be edited and similarly presented in a table asshown in FIG. 1.

FIG. 2 is an example of URL links generated by the present system. TheURL includes hypertext transfer protocol (http) [1], a website addressthat refers to the host name and website server [2], a component thatallows users to hear audio in the website [3], and an unique index code[4] that is generated and associated with a piece of audio clip (timesegment) stored in a database.

FIG. 3 is an example of a preferred use, showing a 2D barcode as part ofthe “instructions for use” label on a bottle of medicine. As previouslynoted, medicine bottles usually have very limited space to carryinformation about the prescription, including pill count, limitations,side effects, dosage, and other critical information. As a result, thedetail is often in small print and very hard to read. Placing a 2Dbarcode on the label to provide an audio signal to announce the selectedinformation is very useful, especially to those who need glasses toassist reading.

FIG. 4 is one example of the table in which the texts in the documentare segmented according to their meaning and associated with their audiotime sequences. Details are as follows:

-   -   POT—Point of Text is the entry point of URL index code. It        points the text corresponding to an audio segment to the website        server that a user uses to hear audio;    -   TL—Text lines carry number of text rows to be combined (since        audio signal is continued). Text document is segmented according        to meaning and placed in sequential rows. Each row represents        the resolution of an audio signal for the text segment. It can        be index by a single row or by combination of a number of rows        continuously;    -   Start and End—Represent audio segmentation indices corresponding        to text contents placed in this row;    -   L_Left and L_Vert—Represent the start location of the text in        the document (left char, line num). It assumes the document        associated with the audio is in one page;    -   R_Left and R_Vert—Represent the end location of the text in the        document (last char, line num). It also assumes the document        associated with the audio is one page; and    -   English—This shows the text segment or an independent sentence        that is stored. In this case, the content is in the English        language. The content can be independent of language or it can        be any language associated with the audio (audio and text may be        in different languages with the same meaning).

FIG. 5 is a flow chart illustrating a preferred method sequencing thegeneral steps for constructing an embodiment of the disclosed system. Asshown, the eight-step process proceeds as follows:

-   -   Step 1: Recording Audio signal (or generate audio using computer        text-to-speech software);    -   Step 2: Associating the original word document with audio. It        can be an article, description, and/or list of instructions,        etc.;    -   Step 3: Generating time code sequences for entire audio signal;    -   Step 4: Editing the word document according to meaning and        subjecting to text content segment blocks;    -   Step 5: Building a table. Each table carries a subject of text        content. There are elements addressing start and end time code        sequence of this subject context, also addresses the location        indices in its word document;    -   Step 6: Assigning each row a URL;    -   Step 7: Building a 2D barcode to carry the URL; and    -   Step 8: Storing the table onto a Cloud database as a head of        audio and text document.

Digital recorded audio signal can be precisely located and segmented bytime code sequences through a time code generator. Time code looks likeHOURS:MINUTES:SECONDS (00:00:00). The HOURS are number between 00 to 23hours, the MINUTES field ranges from 00 through 59 minutes, and theSECONDS field likewise ranges from 00 through 59 seconds. Thecorresponding text can be stored in the memory in a format which can beindexed by the time code sequences. For example, the following recordedaudio signal can be addressed by time code sequences as start at 0:22:15and end at 0:22:29:

Metformin is a medicine used in diabetes mellitus. The information inthis Medicine Guide for metformin hydrochloride varies according to thecondition being treated and the particular preparation used. Take 1tablet by mouth every day with meal

With properly formatted text to match the Time code sequence, one isable to know the start and end time code sequences based on the textused. Placement of a 2D barcode, in which a URL points to text contentstored in the memory, proximate the printed text on the label, possiblywith some indicia (e.g., an arrow) to convey the association between theprinted text and the barcode, is useful. An Internet device, such as amedical pendant, smartphone, etc., which has the ability to scan 2Dbarcodes, can be used to scan the barcode and send the URL to aCloud-based computing platform. Based on the text content link, thecomputer can obtain time code sequences. With the time code sequences, ablock of audio signal is extracted and transferred back to the Internetdevice and, via an audio capability, the instructions are announced tothe user of the device.

In order to effectively sort continuous audio signals, the text contentis edited and grouped in a table format based on meaning or inparagraphs. Then, the associated audio file with subject audio segmentsis correspondingly edited to be defined by time code sequences. Finally,the time code sequences are associated with corresponding text contentblock and placed in the table illustrated in FIG. 4. This builds thelink between static text content and continuous audio signal. Thisprocess is known as “editing.”

Since the URL points to the start point of a selected word content blockas Point of Text (POT) in the first column in FIG. 4, it links to acorresponding audio segment. With the URL, audio signal representing thetext contents can be extracted according to the Total Lines (TL) listedin the second column of FIG. 4. This number indicates how many timeperiods or how many rows will be added and extracted. After the editingprocess, a table is built and releases a group of URLs which link textcontent and audio signals. It is important to have audio start and endtime code sequences to identify the audio segment. The audio signalitself can be recorded by a human or generated by computer software,such as Text-to-Speech, according to the text contents. While used inthe description above, actually generating audio signals from textcontents is not an objective in the present system or methods. However,such audio generation is well-within the knowledge and ability of thoseskilled in the relevant art.

The matter set forth in the foregoing description and accompanyingdrawings is offered by way of illustration only and not as a limitation.While particular embodiments have been shown and described, it will beapparent to those skilled in the art that changes and modifications maybe made without departing from the broader aspects of applicant'scontribution. The actual scope of the protection sought is intended tobe defined in the following claims when viewed in their properperspective based on the prior art.

What is claimed is:
 1. A system for providing an audio signal to anelectronic device via an Internet connection where the audio signal isrelated to printed information associated with a bar code, the systemcomprising: a container having a product therein and printedinstructions thereon associated with the product; a barcode affixed tothe container proximate the printed instructions, wherein the barcodecomprises a URL which links to a server having an audio signalcorresponding to the printed instructions stored thereon; a scanningdevice having an Internet connection for reading the barcode, followingthe URL link to the server, and activating the stored audio signal; anda speaker coupled to the scanning device for playing the audio signal.2. The system of claim 1, wherein the printed instructions are in afirst language and the corresponding audio signal is in a secondlanguage different from the first language.
 3. The system of claim 1,wherein the scanning device and speaker are provided by a singleelectronic device.
 4. The system of claim 3, wherein the container is amedicine bottle and the product is a drug.
 5. The system of claim 4,wherein the printed information comprises instructions for use of thedrug.
 6. The system of claim 1, wherein the scanning device and speakerare separate devices.
 7. The system of claim 1, further comprising atable stored on the server wherein the table comprises a listing of textsegments with corresponding audio segments of the audio signal.
 8. Thesystem of claim 7, wherein the audio segments are defined by start andstop time code sequences.
 9. The system of claim 8, wherein the tablecomprises the start and stop time code sequences of the audio segmentscorresponding to the listed text segments.
 10. A system for providing anaudio signal to an electronic device via an Internet connection wherethe audio signal is related to printed information associated with a barcode, the system comprising: a container having a product therein andprinted information thereon associated with the product; a server havingstorage media, the media having the audio signal and a table storedthereon, wherein the table comprises: a listing of a plurality of textsegments created from the printed information, wherein each text segmentcorresponds to an audio segment of the audio signal; and a listing of aplurality of start and stop time code sequences, each code sequencedefining an audio segment, wherein each code sequence is mapped to thecorresponding text segment of the defined audio segment; a barcodeaffixed to the container proximate the printed instructions, wherein thebarcode comprises a URL which links to the server; a scanning devicehaving access to an audio play application and the Internet, whereinupon reading the barcode and following the URL link to the server, thedevice is configured to activate the stored audio signal via the audioplay application; and a speaker coupled to the scanning device foroutputting the audio signal when activated.
 11. The system of claim 10,wherein the printed instructions are in a first language and thecorresponding audio signal is in a second language different from thefirst language.
 12. The system of claim 10, wherein the scanning deviceand speaker are provided by a single electronic device.
 13. The systemof claim 12, wherein the container is a medicine bottle and the productis a drug.
 14. The system of claim 13, wherein the printed informationcomprises instructions for use of the drug.
 15. The system of claim 10,wherein the scanning device and speaker are separate devices.